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METHOD AND SYSTEM FOR 
COMPUTER-AIDED LESION DETECTION USING 
INFORMATION FROM MULTIPLE IMAGES 



REFERENCE TO RELATED APPLICATIONS 
This application is a continuation-in-part of copending parent application Serial No. 
08/980,254, filed on November 28, 1997. In turn, Serial No. 08/980,254 is a continuation-in 
part of parent applications Serial No. 08/579,802 filed on December 28, 1995 (allowed) and 
Serial No. 08/438,432 filed on May 10, 1995 (now U.S. Pat. No. 5,729,620). In turn. Serial 
No. 08/579,802 is a continuation, and Serial No. 08/438.432 is a continuation-in-part, of 
parent application Serial No. 08/129,255, filed September 29, 1993 (abandoned). This 
application hereby incorporates by reference each of said parent applications into the present 
disclosure. 



FIELD OF THE INVENTION 

The present invention relates to the field of computer aided diagnosis of medical 
images. In particular, the invention relates to a method and apparatus for computer-aided 
lesion detection using information from multiple digital mammogram images for allowing 
more sensitive and reliable identification of suspicious, i.e.. possibly cancerous, lesions. 

BACKGROUND OF THE INVENTION 

Systems for computer-aided diagnosis ("CAD") assist radiologists in the detection and 
classification of abnormal lesions in medical images. The purpose of such devices, as 
described in U.S. Pat. No. 5,815,591 to Roehrig, et. al.. entitled "Method and Apparatus for 
Fast Detection of Spiculated Lesions in Digital Mammograms," the disclosure of which is 
hereby incorporated by reference in the present application, is to direct the attention of a 
radiologist to suspicious areas of the medical image that may reflect a threatening condition. 
While not a replacement for the experienced radiologist, CAD systems are designed to 
increase efficiency and reduce error, as a typical radiologist may be required to examine 
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hundreds of medical images per day, which can lead to the possibility of a missed diagnosis 
due to human error. 

Desired characteristics of a CAD system for analyzing mammograms include higher 
sensitivity, i.e., the ability to detect more subtle indications of abnormalities, coupled with 
lower false positive rates, i.e.. the number of areas marked "suspicious" by the CAD system 
5 which, in reality, are not suspicious or indicative of a possibly cancerous condition. 

Generally speaking, it is desirable to minimize both the rate of false negatives, also called 
"misses", as well as the rate of false positives. 

Today, conventional CAD systems usually treat each digital mammogram separately. 
In these systems, the plurality of mammograms that are usually taken of a woman's breasts'- 
10 for example, the craniocaudal ("CC") and mediolateral oblique ("MLO") views of each of the 
left and right breasts, respectively - are digitized into digital mammograms and processed 
separately by the CAD system for detecting suspicious lesions. Suspicious lesions are located 
on each of the four images separately, without regard for what regions are found or not found 
in the other images. Although "mammogram" is sometimes used in the art to depict a set of 
four related films or views but sometimes used to depict one such view, for clarity purposes 
the term "mammogram" shall correspond to a one of the related films or views taken during 
the mammography process. 

However, in radiology practice it has been found that if the same abnomiality appears 
m two different views of the same breast, then that abnormality has a higher probability of 
being a true lesion. This is because nomial overlying tissue structures mav accidentally 
appear to be an abnormal lesion in a single digital mammogram, tissue structures which will 
appear different or nonexistent in a differem view. Accordingly, there is a lower probabilitv 
of false positives when two different views of the same breast are examined, due to the lower 
probability of false or accidental crossing of tissue structure in the same region on two 
25 separate views of one breast. 

Additionally, in radiology practice it has been found that if similar potentially 
suspicious structures are found in both the left and right breast, then those structures have a 
lower probability of being true lesions. Likewise, if a potentially suspicious structure is found 
.n one breast but no corresponding structure is found in the opposite breast, there is a higher 
probability that the structure represents a true lesion. This is because normal tissue structure 
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is usually similar between left and right breasts. 

Moreover, if a breast develops a potentially suspicious lesion over a period of time as 
reflected by periodic mammograms of that breast, the likelihood increases that it is a true 
lesion. Accordingly, it is often usefiil to compare similar mammogram views of the same 
breast taken at different times, typically twelve months apart. 
5 In comparing multiple views of a single breast or opposing breasts, it is necessary to 

have a common reference from which to measure the location of potentially suspicious 
lesions in each view. One such reference point is the nipple of the breast. A problem arises, 
however, in that the breast is often manipulated during the mammography process in various 
ways, such that the nipple may be in different and sometimes unpredictable locations in the 
10 digital mammogram. The nipple may, or may not, correspond to the location along the skin 
line fiirthest from the chest wall. 

In "Computerized detection of masses in digital mammograms: Analysis of bilateral 
subtraction images," Med. Phys. 18 (5), Sep/Oct 1991, Yin and Giger et. al. disclose a bi- 
lateral subtraction technique, in which one image is rotated and translated to best match the 
15 other image, and then left and right images are subtracted from each other pixel-by-pixel. 
The resulting difference image is then thresholded to obtain several "starting points" which 
represent the areas of largest difference between left and right breasts. However, in the Yin 
and Giger et. al. disclosure, it is only raw pixels that are compared between left and right 
breasts, and the simple output obtained is only a starting point for ftirther analysis. 
20 In U.S. Pat. No. 5,579,360, Abdel-Mottaleb describes mass detection by computer 

using digital mammograms of the same breast taken from different viewing du-ections. 
Abdel-Mottaleb describes a method in which position, size, shape, intensity variance, and 
brightness are each directly compared between the two views of the same breast. The 
disclosed Abdel-Mottaleb method is disadvantageous, however, in that if any one such 
25 measure between views does not correlate within specified boundaries, the suspect spot is 

marked as a false positive, whereas correlated spots meeting all criteria lead directly to a mark 
on the output display directing the attention of the radiologist to that spot. Such a binary 
approach can often accord inordinate weight to the inter-view comparison process, at the 
expense of strong indicators that may still exist within a single view. 
30 Accordingly, it would be desirable to provide a computer-aided diagnosis system that 
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uses information from multiple digital mammograms to provide sensitive, fast, and reliable 
identification of suspicious, lesions in a digital mammogram. 

It would be fiirther desirable to provide a computer-aided diagnosis system that 
processes information from a first digital mammogram view of a breast, together with 
comparative information from a plurality of views of the same breast, to arrive at an overall 
5 suspiciousness determination regarding potentially suspicious lesions in the first digital 
mammogram view. 

It would be further desirable to provide a computer-aided diagnosis system capable of 
locating the nipple in a digital mammogram in a reliable manner that accommodates different 
nipple locations corresponding to different breast manipulations that may take place during 
10 the mammography process. 

It would be further desirable to provide a computer-aided diagnosis system that 
processes information from a first digital mammogram view of a breast, together with 
comparative information from a digital mammogram of the opposite breast, to arrive at an 
overall suspiciousness determination regarding potentially suspicious lesions in the first 
15 digital mammogram view. 

It would be even further desirable to provide a computer-aided diagnosis system that 
processes information from a first digital mammogram view of a breast, together with 
comparative information from a digital mammogram of the same breast taken earlier in time, 
to arrive at an overall suspiciousness determination regarding potentially suspicious lesions in 
20 the first digital mammogram view. 

It would be still further desirable to provide a computer-aided diagnosis system that 
processes information from a first digital mammogram view of a breast, together with 
comparative information from (a) a differem digital mammogram view of the same breast, (b) 
a digital mammogram of the opposite breast, and (c) a digital mammogram of the same breast 
taken earlier in time, to arrive at an overall suspiciousness determination regarding potentially 
suspicious lesions in the first digital mammogram view. 

SUMMARY OF THE INVENTION 

These and other features are provided in a system, method, and computer program 
product for computer-aided detection of suspicious lesions in digital mammograms, wherein 
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single-view feature vectors from a first digital mammogram are processed in a classification 
algorithm along with information computed from a plurality of related digital mammograms 
to assign an overall probability of suspiciousness to potentially suspicious lesions in the first 
digital mammogram. In a preferred embodiment, a first digital mammogram and a second 
digital mammogram taken fi-om a different view of the same are processed, with single-view 
5 feature vectors corresponding to potentially suspicious lesions being separately computed for 
each digital mammogram and then compared to produce similarity metrics. If a potentially 
suspicious lesion in the first digital mammogram has a high degree of similarity with a 
potentially suspicious lesion in the second digital mammogram, there is a greater probability 
that the potentially suspicious lesion is a true lesion. 
10 In another preferred embodiment, a first digital mammogram and a second digital 

mammogram taken from opposite breasts are processed, with single-view feamre vectors of 
potentially suspicious lesions being separately computed for each digital mammogram and 
then compared to produce symmetry metrics. If a potentially suspicious lesion in the first 
digital mammogram has a high degree of similarity with a potentially suspicious lesion in the 
15 second digital mammogram, there is a lesser probabilit>' that the potentially suspicious lesion 
is a true lesion. 

In another preferred embodiment, a lesser probability of suspiciousness is found 
where there are similar lesions or structures located in the first digital mammogram and a 
digital mammogram of the same breast taken months or years earlier in time. In still another 

20 preferred embodiment, single-view feature vectors from a first digital mammogram are 
classified in conjunction with information from each of (a) symmetry metrics computed in 
relation to a digital mammogram of the opposite breast, (b) similarity metrics computed in 
relation to a digital mammogram of the same breast taken from a different view, and (c) 
similarity metrics computed in relation to the same breast taken at a prior time. Symmetry 

25 and similarity metrics taken from related views are not used as hard limiters directly coupled 
to the output display, but rather serve as useful data to influence the probabilistic outcome of 
a single-view classification scheme in accordance with a preferred embodiment. 

In another preferred embodiment, the nipple location is determined using an algorithm 
that takes into account the chest wall, the skin line of the breast, and the general orientation of 

30 the fibrous breast tissue in the digital mammogram relative to the chest wall. The nipple 
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location is determined by segmenting the digital manmiogram for determining the position of 
the chest wall of the breast, determining a most prominent direction of lines in the breast 
tissue relative to the chest wall for the digital mammogram, segmenting the digital 
mammogram for determining the location of the skin line of the breast, and selecting the 
location of the nipple as the furthest point along the skin line from the chest wall as measured 
along the most prominent direction of lines. 



BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 A shows an outside view of a computer aided diagnostic (CAD) system; 
FIG. IB shows a block diagram of CAD processing unit; 

FIG. 2 shows overall steps performed by a CAD processing unit in accordance with a 
preferred embodiment; 

FIG. 3 shows steps for locating suspicious lesions using multiple digital mammogram 
views of a breast in accordance with a preferred embodiment; 

FIG. 4 shows sketches of two digital mammograms having different nipple positions; 

FIG. 5 shows steps for identifying nipple location in accordance with a preferred 
embodiment; 

FIG. 6 shows steps for locating suspicious lesions using multiple digital mammogram 
images in accordance with a preferred embodiment; 

FIG. 7 shows steps for locating suspicious lesions using multiple digital mammogram 
images in accordance with a preferred embodiment; 

FIG. 8 shows an FROC curve corresponding to a computer-aided lesion detection 

device; 

FIG. 9 shows an optimization curve used to generate an empirical detennination of a 
weighting coefficient used in a computer-aided lesion detection device; 

FIG. 10 shows clip distance optimization plots corresponding to a computer-aided 
lesion detection device; and 

FIG. 1 1 shows optimization plots corresponding to a technique for determining a 
maximum improbability associated with suspicious lesions in alternate views. 
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DETAILED DESCRIPTION 

FIG. 1 A shows an outside view of a computer aided diagnostic (CAD) system 100. 
such as the Image Checker Ml 000 from R2 Technology, Inc., for assisting in the 
identification of suspicious lesions in mammograms. CAD system 100 comprises a CAD 
processing unit 102 and a viewing station 104. In general, CAD processing unit 102 scans an 
x-ray mammogram into a digital mammogram image, processes the image, and outputs a 
highlighted digital mammogram for viewing at viewing station 104. FIG. IB shows a block 
diagram of CAD processing unit 102. CAD processing unit 102 comprises a digitizer 103, 
such as a laser scanner with 50 micron resolution, for digitizing a developed x-ray 
mammogram 1 0 1 , the x-ray mammogram 1 0 1 being shown in Figure I A at an input to the 
CAD processing unit 102. CAD processing unit 102 generally includes elements necessary 
for performing image processing including parallel processing steps. In particular, CAD 
processing unit 102 includes elements such as a centra] control unit 105, a memory 108, a 
parallel processing unit 1 10. and I/O unit 112. It is to be appreciated that the parallel 
processing unit 1 1 0 shown in FIG. IB may be replaced by a single processor without 
15 departing from the scope of the preferred embodiments. It is to be appreciated that in 

addition to the suspicious lesion detection algorithms disclosed herein, processing unit 102 is 
capable of performing a multiplicity of other image processing algorithms either serially or in 
parallel therewith. 

Viewing station 104 is for conveniently viewing both the x-ray mammogram 101 and 
the output of the CAD processing unit 102 on a display device 118. The display device 1 18 
may be, for example, a CRT screen. The display device 1 18 typically shows a highlighted 
digital mammogram corresponding to the x-ray mammogram 101, the highlighted digital 
mammogram having information directing the attention of the radiologist to suspicious areas 
as determined by image processing steps performed by the CAD processing unit 102. In one 
25 preferred embodiment, the highlighted digital mammogram will have black or red circles 
superimposed around those locations corresponding to suspicious lesions. Viewing station 
104 also comprises a backlighting station 120 for viewing the actual x-ray mammogram 101 
itself The radiologist is assisted by the CAD system 100 by viewing the display device 1 18, 
which then directs the attention of the radiologist to the suspicious portions of the actual x-ray 
30 mammogram 101 itself. Further information regarding CAD system 1 00 may be found in 
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U.S. Pat. No. 5,815,591, supra. 

It is to be appreciated that in addition to being able to display a single view of one 
breast, CAD system 100 may be used in accordance with the preferred embodiments to 
simultaneously display information related to multiple views of the same breast, similar views 
of opposing breasts, and/or views of a single breast taken at different points in time. Thus, 
the attention of the radiologist may be drawn to specific areas of a first mammogram image 
by CAD system 100, which can then be compared to corresponding areas of other views of 
the same breast, views of the opposing breast, or previous views of the same breast for 
making an appropriate determination. 

FIG. 2 shows the general steps performed by CAD processing unit 102 on the x-ray 
mammogram. At step 202, multiple related x-ray mammograms are scanned in and digitized 
into digital mammograms. To create the x-ra>'s mammograms, the breast is positioned and 
compressed between two plates before the X-ray is actually taken. Two views, corresponding 
to two approximately orthogonal orientations of the compression planes are taken, typically 
called craniocaudai (CC) view and mediolateral oblique (MLO) view. The resulting four 
films are developed, and digitized by the CAD system 1 00 to enable computer analysis at step 
202. As an alternative to the manual x-ray development following by digitization step 202, 
the x-ray detector, which is presently usually a film screen cassette, can be replaced by a 
direct digital detector such as the General Electric Full Field Digital Mammography System, 
and the resulting digital image fed directly to the CAD processor unit 102. 

While in one embodiment the multiple related x-ray mammograms correspond to two 
views of the same breast, e.g.. the craniocaudai (CC) and the mediolateral oblique (MLO) 
view, in another embodiment the multiple related x-ray mammograms correspond to similar 
views of two opposing breasts, e.g., the MLO view of the left and right breast of a single 
subject. In yet another embodiment, there are three related x-ray mammograms wherein the 
first two are different views of the same breast, e.g., the CC and the MLO views, and the third 
being a view such as a the MLO view of the opposing breast. In still another embodiment, 
there is a fourth, historical x-ray mammogram corresponding to the first x-ray mammogram 
except that it has been taken months or years earlier in time that is entered into the CAD 
processing unit 102 for digitization. It is to be appreciated that there are further combinations 
of the above x-ray mammograms to be input into the CAD processing unit 102 that are within 
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the scope of the preferred embodiments. It is to be further appreciated that the historical x- 
ray mammogram that was taken months or years earlier in time may have been stored in 
digitized form in CAD computer memory 108, or other digital storage medium, without 
departing from the scope of the preferred embodiments. Alternatively, to save storage space, 
only a historical set of feature vectors derived from prior digital mammograms may be stored 
S in the CAD memory 1 08. Indeed, the CAD memory 1 08 or other storage medium may 
contain an entire historical archive of prior digital mammograms taken of the same breast or 
feature vectors derived therefrom, and CAD processing unit 102 may be modified to compare 
any of these historical digital mammograms or feature vectors derived therefrom to the 
current digital mammogram. 
10 Each digital mammogram may be, for example, a 4000 x 5000 array of 1 2-bit gray 

scale pixel values. Such a digital mammogram would generally correspond to a typical 18 cm 
X 24 cm x-ray mammogram which has been digitized at a 50 micron spatial resolution. 
Because a full resolution image such as the 4000 x 5000 image described above is not always 
necessary for the effectiveness of the preferred embodiments, the image may be locally 
15 averaged, using steps known in the art, down to a smaller size corresponding, for example, to 
a 200 micron spatial resolution. 

As shov^ in FIG. 2, the digital mammograms are processed at step 204 by an overall 
suspicious lesion detection algorithm in accordance with the preferred embodiments. As 
discussed previously, the overall lesion detection algorithms performed at step 204 generate a 
20 list of locations in at least one of the digital mammogram images which correspond to 
suspicious lesions, Le. possibly cancerous lesions. Following step 204, the digital 
mammogram images and list of suspicious locations is sent for display to the viewing station 
104 at step 206. 

FIG. 3 shows steps corresponding to step 204 for locating suspicious lesions in 
25 accordance with a preferred embodiment, wherein two views of the same breast are processed 
for identifying suspicious lesions in at least one of the views. In the example of FIG. 3, the 
two views processed are the craniocaudal view (CC) and the mediolateral oblique view 
fMLO), although other views of the same breast may be used in accordance with the preferred 
embodiments. At step 302 a segmentation algorithm is performed on each of the digital 
30 mammogram view, Le,, the CC and MLO views in this example. As known in the art, one 
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purpose of segmentation is to specify reference locations from which positions in the breast 
may indexed. Among other features, the position of the chest wall and nipple are determined 
at step 302. In a preferred embodiment, locations of potentially suspicious lesions are then 
specified with respect to the chest wall and the nipple, although other positional metrics may 
be used as well. Importantly, location coordinates with respect to the chest wall and the 
nipple are carried across views of the same breast, as well as across views of opposing 
breasts, to when comparing features among the respective views. 

At step 302, as an intermediate step in determining the position of the nipple, the skin 
line is segmented. Algorithms to locate the skin line have been described in the literature, 
one such method being described in Patent No. 5,452,367 to Bick and Giger, the contents of 
which are hereby incorporated by reference into the present application. The nipple is 
expected to lie somewhere along the surface of the skin line. 

FIG. 4 shows an example of differing digital mammograms having different nipple 
positions relative to the skin line and chest wall. FIG. 4 shows a side view of an "ideal" 
digital mammogram 402 comprising a chest wall 404, fibrous tissue 406, a skin line 408, and 
a nipple 410. The digital mammogram 402 represents an "ideal" situation in that the nipple 
4 1 0 is actually the point along skin line 408 that is farthest from the chest wall 404 in an 
orthogonal direction. Accordingly, in the ideal situation a CAD system can readily and 
accurately locate the position of nipple 410 by locating the point along skin line 408 that is 
farthest from the chest wall 404 in an orthogonal direction. 

In practice, however, it is often found that the true position of the nipple varies 
significantly from the position of nipple 410 in FIG. 4 due to imperfect positioning, 
compression, or manipulation of the breast during the x-ray mammography process. FIG. 4 
also shows a practical digital mammogram 412 comprising a chest wall 414, fibrous tissue 
416, a skin line 418, and a nipple 420. As shown in FIG. 4, nipple 420 is at a substantially 
different position than the "ideal" position. It has been found that a statistically significant 
number of prominent lines in the fibrous tissue 416 tend to point toward the true position of 
the nipple 420 in practical digital mammograms. This is shown generally by an arrow 
positioned at an angle ALPHA with respect to the chest wall 414 in the practical digital 
mammogram 412. If a histogram of the directions of all large lines (ducts) is computed, a 
peak is generally evident in the direction pointing to the nipple, the peak being at 
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approximately 100 degrees in the practical example of FIG. 4. 

FIG. 5 shows steps taken during the segmentation step 302 to locate the (x,y) position 
of the nipple 420 in accordance with a preferred embodiment. At step 502 the chest wall is 
segmented using methods known in the art. At step 504, the skin line is segmented using 
steps known in the art, as described supra. At step 506 the prominent direction of lines a are 
5 identified in the digital mammogram with respect to the chest wall. The computation of the 
most prominent direction of lines may be computed using histogram-based plotting methods 
or other methods known in the an. Finally, at step 508, the (x,y) location of the nipple is 
determined as the intersection of the skin line with the longest line that can be drawn between 
the chest wall and the skin line at an angle a with respect to the chest wall. In this fashion, 
10 the nipple position is more reliably and accurately determined, the nipple position being of 
importance because it serves as a reference or index point for specifying locations of 
potentially suspicious breast lesions in the digital mammograms being compared. 

Once the locations of the chest wall and nipple are determined at step 302, positions in 
the digital mammogram views may then be referenced with respect to the chest wall and/or 
15 nipple for purposes of feature comparison. These reference positions are used for feature 
comparisons different views of the same breast, as well in feature comparison among views 
of opposing breasts. In one preferred embodiment, feature position is specified by the 
coordinates (d^, Ax, Ay), where d,, represents distance from the chest wall, and where Ax and 
Ay represent distances from the nipple position. In another preferred embodiment, feature 
20 position may be specified by the (Ax, Ay) coordinates alone. In still another embodiment, it 
has been found that the direct radial distance from the nipple alone, Rn,pple> is a sufficient 
location metric to produce acceptable resuhs for feature comparisons. For simplicity and 
clarity purposes, and without limiting the scope of the preferred embodiments, the remainder 
of this disclosure uses the simple scalar quantity R^ippLE as the position metric for feature 
25 comparison purposes. 

Subsequent to the segmentation step 302, a single-view feature vector computation 
step 304 is performed, wherein each digital mammogram view is separately processed for 
computing single-view feature vectors associated therewith. The specific feature vectors 
computed at step 304 depend on which overall suspicious lesion detection algorithm is 
30 employed. Any of a number of available algorithms may be used for the purpose of 
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determining suspicious lesions in a single digital mammogram view including, but not limited 
to: U.S. Pat. No. 5,815,591 to Roehrig et. al.: U.S. Pat. App. No. 08/868.277 to Karssemeijer 
et. al.; U.S. Pat. No. 5,657,362 to Giger et al; U.S. Pat. No. 5,491,627 to Zhang et al; U.S. Pat. 
No. 5,537,485 to Nishikawa et al; and te Brake and Karssemeijer, Detection of Stellate Breast 
Abnormalities, Digital Mammography 1996. K. Doi, Mary Ellen Giger, Robert Nishikawa, R. 
5 Schmidt, eds., the contents of which are incorporated by reference into the present 
application. It is necessary that the chosen algorithm be designed to yield substantially 
correct results on "true" lesions with reasonable sensitivity and with as few spurious markers 
as possible. In a preferred embodiment, an area feature corresponding to the lesion area 
should also be computed, regardless of whether it is needed by the single-view lesion 
10 detection algorithm used. The area metric may become important in cross-view feature 
comparison steps, as further described infra. 

The results of the single-view feature computation step 304 include a plurality of 
feature vectors for each digital mammogram view. Often, depending on the single-view 
lesion detection algorithm chosen, there are many such feature vectors. There may be fewer 
15 feature vectors, however, if the selected single-view lesion detection algorithm is designed to 
discard feature vectors "on the fly" upon an on-the-spot-determination that a region or pixel 
will never be interesting. Although the contents of the feature vectors will vary depending on 
the particular single-view algorithm or algorithms used, each feature vector may contain, for 
example, the following features: location (e.g., the distance R,^,,„ described supra); area- 

0 contrast: spiculatedness; and eccentricity. It is to be understood that there may be a greater 
number or a lesser number of elements in the feature vectors without departing from the 
scope of the preferred embodiments, and that the type of metrics contained in the feature 
vectors may also be different than in the above example. 

At step 306, the single view feature vectors are processed in a classification algorithm 
5 to identify potentially suspicious lesions in the respective single-view digital mammograms 
It IS to be appreciated that step 306 may be combined with step 304 in some algorithms for 
which feature vector computation and lesion detection take place in a single step. The 
classification scheme used to identify potentially suspicious lesions at step 306 in each of the 
digital mammogram views may be any of a variety of classification algorithms including 

1 neural network algorithms, linear classifier algorithms, quadratic classifier algorithms, etc. 

Upon completion of step 306. CAD processing unit 102 contains two sets of feature 
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vectors, one set for each of the CC and MLO views, as illustrated below in TABLE 1 . 



TABLE 1 



MLO VIEW 


CC VIEW 


[ foi fn ^21 faj ] 


[goi gll g2l §31 ] 


[ ^02 ^22 ^32 ] 


[ g02 gl2 g22 g32 ] 


[ ^03 fl3 ^23 ^33 ] 


[g03 g|3 g23 g33] 


[ fo4 f|4 f24 ^34 ] 


[g<M gl4 g24 g34] 


. . . (etc.) 


. . . (etc.) 



In TABLE 1, the MLO feature vectors are designated as follows: for the i"" potentially 
suspicious lesion, the related feature vector is denoted [ 4 f„. f^^ f3,. ], where fo, f„ f,, and 
fj, are each scalar feature metrics for the i* potentially suspicious lesion. Likewise, for the i* 
potentially suspicious lesion in the CC view, the related feature vector is denoted [ g^., g„ g,. 
gji ], where goi. g,i. g^j and gj, are the same type of feature metrics as f,; f,; and f,, except 
they are measured in the CC view. By way of non-limiting example, in the embodiment of 
FIG. 3 and TABLE 1, f,,, represents the distance R^ipple if the i* potentially suspicious lesion 
from the nipple; f„. represents the area of the i"^ potentially suspicious lesion; f,^ represents the 
contrast of the i* potentially suspicious lesion; and represents a spiculatedness measure 
associated with the i'" potentially suspicious lesion computed, for example, using the method 
of U.S. Patent No. 5,815,591, supra. 

Importantly, it is to be understood that the feature vectors of TABLE 1 may contain all 
of the metrics, or just a portion of the metrics, computed at steps 304-306. Moreover, it is to 
be appreciated that the feature vectors shown in TABLE 1 may contain a greater or fewer 
number of metrics than the exemplary value of four, and that the nature of the individual 
metrics may be different than location, area, contrast, and spiculatedness. For example, in 
one preferred embodiment, only a location metric, an area metric and a contrast metric are 
used. In another preferred embodiment, an additional metric is used corresponding to the 
single-view probability of suspiciousness as determined at step 306. Finally, it is to be 
appreciated that although the feature vector elements fo, f,, f,, and f,, are scalars in the above 
example, one or more of these elements may in themselves be vectors or matrices without 
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departing from the scope of the preferred embodiments. 

At step 308, a similarity metric is computed between each MLO feature vector and 
each CC feature vector. In relation to step 308, the preferred embodiments are based at least 
in part on the finding that correlation of a true lesion between CC and MLO views is only 
approximate, because suboptimal breast positioning of the two images will cause the lesion 
5 position to differ somewhat in the two images. Sometimes, especially when the lesion is 
close to the chest wall, the lesion will fail to appear at all in one view due to the breast not be 
pulled out enough in that view, but still appear in the other view. An automated lesion 
detection method that exploits multiple view correlation should use cross-view correlations in 
a softer or more analogue manner, rather than in a hard binary yes/no manner. 
10 Accordingly, at step 308 a similarit\' metric is computed between each MLO feature 

vector and each CC feature vector. Each similarity metric takes the form of a cost function 
measured as the weighted distance between two feature vectors in feature vector space. An 
exemplary form of the cost function, shown between the j'" MLO feature vector and the k"" 
CC feature vector and represented by the symbol Cjy, is shown in Eq. 1 . 



15 



20 



25 



30 



Each potentially suspicious lesion in the MLO view will have N associated similarity 
metrics, where N corresponds to the number of potentially suspicious lesions that were 
identified from the CC view. Each of the respective similarity metrics computed by Eq. 1 is 
equal to a Euclidean distance in weighted form between the feature vector in the MLO view 
and each feature vector in the CC view as measured in feature space. It is easily seen from 
Eq. 1 that the similarity metric between two potentially suspicious lesions will be siiialler if 
their respective feature vector metrics are very similar, i.e., if their characteristics are similar, 
whereas the similarity metric will be greater if the two potentially suspicious lesions are not 
similar. 

It is to be appreciated that the cost fiinctions shown in Eq. 1 that is used as the 
similarity metric is only one of a representative sample of many different cost functions which 
may be used in accordance with a preferred embodiment. Generally speaking, any cost 
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function representing a feature space distance between two feature vectors can be used if it 
will have a global extremum. e.g., a minimum value, when two feature vectors are identical to 
each other, and a monotonic character moving away from the extremum as the feature vectors 
get further away from each other. 

Assuming normalization of features, the relative sizes of coefficients a^, a,, a„ and a, 
are determined by the relative importance of the features, which is empirically determined. 
The most important feature will be assigned the largest coefficient, the next most important 
feature the next largest coefficient, and so on down to the least important feature, which is 
assigned the smallest coefficient. The number of features from the single-view feature 
vectors that will actually be used, or equivalently, how many of the coefficients a„ have 
significant magnitude, is also empirically determined and may vary as the algorithm is 
refined. The empirically determined useful features according to a preferred embodiment use 
the nipple distance Rn.pple as the most imponant feature, region size or area as the second 
feature element, and single-view probability from the first single image classifier as the third 
feature vector element. 

It is also found that two distances, one from the nipple (Rn.pple) and one from the 
chest wall (d^), appear to be useful because occasionally the nipple distance is difficult to 
determine and there may be a large error. Also, if the lesion happens to be close to the chest 
on a large breast, the chest wall distance d^, appears to have less error than the nipple distance 
Rnipple- However, sometimes due to poor positioning in one view, the chest wall distance d^ 
may be abnormally large, in this case the nipple distance R^^^^^ is more reliable. 

The area of the lesion is important as a feature exists for at least two reasons. First, 
the area of a true lesion seems to maintain itself across views very well. Second, the area of 
the lesion is not used in a single-view lesion detection algorithm. Area is a new piece of 
information that becomes usefiil only when comparing two views because true lesions come 
in a spectrum of sizes from small to large. Size in itself is not an indicator of whether the 
lesion is true when looking at a single view. Hence, area itself is not an important indicator 
of trueness, but the difference in area between two views is an important indicator showing 
consistency between the views. Finally, the single-view suspiciousness probability is 
important because there are a number of single-view features that are highly correlated to 
"trueness" of a lesion. 

As indicated previously, it is to be appreciated that not all feature metrics computed 
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at step 304 need to be used in generating the similarity metrics at step 308. Indeed, in a 
simpler implementation in accordance with a preferred embodiment, there are only two 
features used in the computation of the similarity metrics: (1 ) fo, = Rnipple- and (2) f,, = area. 
In this preferred embodiment, it has been empirically found that appropriate weights across 
views are ao = 1 .0, and a, = 0.2. It is to be appreciated that if all coefficients are set to zero 
5 except for a^ the distance in feature vector space actually becomes a true physical distance 
difference, equal to the difference between Rjj,pple in the MLO view and Rn,pple in the CC 
view. 

At step 3 11, an overall classification algorithm is used to determine the suspicious 
lesions to output to the displa>- 1 1 8. The classification algorithm used at step 3 1 1 may be any 
10 of a variety of algorithms, but importantly will have inputs corresponding to (1 ) the feature 
vectors computed at steps 304-306. and (2) the similarit>' metrics computed at step 308. In 
this manner, a CAD system 100 in accordance with the preferred embodiment is capable of 
using information from both single view feature vectors as well as information from a 
comparison of two views of the same breast, to arrive at a final determination of 
15 suspiciousness. The classification algorithm at step 3 1 1 may be any of a variety of classifiers, 
provided that it is appropriately influenced by both the single-view feature vectors and the 
similarity metrics. Other factors being equal, the overall probability of suspiciousness should 
be greater where the similarit>- metric reflects a high degree of similarity between 
corresponding lesions in two views. 
20 Advantageously, in accordance with a preferred embodiment, there are no "hard'* or 

"yes/no" decisions associated with single view information or comparison information 
separately. Rather, the information is all fed into a classification algorithm at step 3 1 1 for a 
final determination to be made. In this way, it is possible that even though there is very little 
correspondence between two views of the same breast for a given lesion, this lesion may still 
25 be identified as an overall suspicious lesion, if the single view feature vectors indicate a very 
strong probability of suspiciousness. Advantageously, steps taken in accordance with the 
preferred embodiments are designed to approximate the thought process that a human 
mammographer will perform when searching for lesions, while maintaining as low a work up 
rate (the rate at which routine screening mammograms call for further workup such as spot 
30 compression, magnification views, ultrasound, etc.) is possible. 

FIG. 6 shows steps corresponding to step 204 for locating suspicious lesions in 
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accordance with another preferred embodiment in which, in addition to the computation of 
similarity metrics from alternate views of the same breast, a set of symmetry metrics are 
computed from views of opposing breasts. As shown in FIG. 6, the steps 602, 604, and 606 
are carried out in a manner similar to the steps 302, 304, and 306 of FIG. 3, except that a 
digital mammogram view of the opposing breast is processed in addition to the MLO and CC 
5 views of the first breast. By way of non-limiting example, the MLO view of the opposing 
breast is used in the embodiment of FIG. 6, although other views may be used. Included in 
the results of steps 604-606 is an additional set of feature vectors [ h^j h, , h,j h~- ], where 
hoi. h,j. hj, and hjj are the same type of feahire metrics as fo,, f,j fjj and f,, except they are 
measured in the MLO view of the opposing breast. 
10 As shown in FIG. 6, an additional step 609 is carried out in parallel with the step 608. 

wherein a set of symmetry metrics between the MLO view of the first breast and the MLO 
view of the opposing breast is computed. In relation to step 609, the preferred embodiments 
are based at least in part on the finding that symmetry between left and right breasts is only 
approximate even when the breasts are positioned perfectly. The tissue structure in the two 
15 breasts will always differ somewhat. Hence, the importance of a determination that a density 
on one breast is or is not mirrored in the other breast, and to what degree, is a relative 
judgment best incorporated in a symmetry metric in accordance with the preferred 
embodiments. 

Thus, at step 609, symmetry metrics between a digital mammogram of the opposing 
breast are computed between the first digital mammogram (eg, the MLO view of the first 
breast) and a corresponding view of the opposing breast. It is to be appreciated that while 
MLO-MLO symmetry metrics are computed at step 609, it is not necessary to compare 
similar views of the opposing breast in order to be within the scope of the preferred 
embodiments. It is permissible that a third view of the opposing breast may be used that does 
not correspond to either of the views used for the first breast, although the preferred 
embodiment as disclosed herein shows identical views of opposing breasts being processed. 
The steps used to compute the symmetry metrics at steps 609 are similar to the steps used to 
compute the similarity metrics at step 608 except that feature vectors [ ho^ h„ h^^ hj, ] from 
the opposing breast are used. TABLE 2 and Eq. 2 below illustrate the step 609 of computing 
the symmetry metrics. 
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TABLE 2 



MLO - Breast 1 


MLO - Opposing Breast 


[ foi ^] I ^21 ^31 ] 


[hoi h,, h,, hj, ] 


[ ^02 ^12 ^22 ^32 ] 


[ ] 


[ fo3 fl3 ^23 ^33 ] 


[ho3 h,3 h33] 


[ fo4 ^24 ^34 ] 


[ho4 h34] 


. . . (etc.) 


. . . (etc.) 



^jk-f^for^^ Eq.2 

The symmetry metrics for each potentially suspicious lesion in the MLO view of the 
first breast correspond to the cost functions Dji. in Eq. 2. It is to be appreciated that the 
weights bo , b,, b2, and bj are generally different than the weights ao, a„ a2, and a3 used to 
compute similarity metrics at step 608. However, the empirical methods for deriving their 
values are generally similar. As with the steps taken at step 608, a given cost function Dj,. 
will be small when the associated potentially suspicious lesions are similar, have similar 
feature vector metrics, and will be greater when the lesions are not similar. Also as with step 
608, the constant bp associated with the first element of the feature vector, which is the nipple 
distance Rnipple^ will generally be the largest weight afforded in Eq. 2. This is because, as 
intuitively suspected, the location of a lesion in one view is generally the most important 
factor in determining whether it corresponds to a lesion in another view. 

At step 6 11, an overall classification algorithm is used to determine the suspicious 
lesions to output to the display 1 1 8. The classification algorithm used at step 61 1 may be any 
of a variety of algorithms, but importandy will have inputs corresponding to (1) the feature 
vectors computed at steps 604-606, and (2) the similarity metrics computed at step 608, and 
(3) the symmetry metrics computed at step 609. Other factors being equal, the overall 
probability of suspiciousness for a given lesion should be reduced when there exists a 
symmetric feature in the opposing breast, as indicated by a low symmetry metric. 
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FIG. 7 shows steps corresponding ,o step 204 for locating stKpicious lesions in 
accordance with another prefe^ed entbodiment in which, in addition to the computation of 
s-mtlaHty ntetrics fro. alte^te views of the san,e breast and synjet,,, metrics contpnted 
from vtews of opposing b„as,s. a set of similarity metrics with aprior view of ,h. breast is 
computed. Generaliy speaking, the prior digital mammogram ™s taken 6-12 months before 
the cunent dtgita, mammogram, but the scope of the preferred embodiments is not so limited 

In the algorithm of FIG. 7. steps 702, 704. 706, 708 and 709 are carried out in a 
manner similar to steps 602. 604, 606, 608 and 609 of F,0. 6. By way of no„-limi«„g 
example, a prior MLO view of the breast is used, although other views may be used 

'-"^'''tatheresults„fsteps704-706isa„.ddi«o„alse.offea„,revectors(p„ p, p 
10 P. J, where p, p„ p, p„ ^ ^ as f.. f, f 2, f jl . 

.hey are measured in the prior MLO view. ' ^ " 

708 and 09 wherem a set of similarity metrics between the cm,.n, MLO view of the L 
breast a^d the prior MLO view of the ftrst breast is computed. In .elation to step 7, ^ 
.5 pre etred embodiments are based at least in par, on the finding in temporal subtltio: te 
o ks for Change in the lesion from prior examination to cut^nt examination. B« this' Z is 
only approxtmate . one must allow some diffetence in lesion position due to slightly Iffl! 
~o„ and positioning. Also, one may consider the cutrent year lesion to e 
u P,c oos not only if a change occutred, such as size, number of calcifications etc Teven 
2» regardless of change, if the pmbabiiity a single view is high enough. Hence he 

?'"'""°"*''°''^-^"-------'--".-Cinthe ■ 

1 2 months, and to what deg^, is a ..lative Judgment best incorporated in a simLty 
metncrn accordance wid, the preferied embodiments. "^^-mtlarity 

25 used to ™' "T"" '° """""" *° """"""^ '•'^ 'I ° - <o .he steps 

uedtocompute,hesimilaritymetri=sats,ep608exceptthatfea.revecto,.tP. P p 
ftom.hepnorMLOviewa.used. TABLE 3 and E,. 3 below illustrate J:;7;o:; 
computing the similarity metrics. 
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TABLE 3 



5 



1 MLO - RrpaQt 1 /'r*nrr<*»i*\ 


MLO - Breast I (prior) 


ffo. f,, f2, f3,] 


[Poi Pi I P21 P3, ] 


1^02 ^12 ^22 ^J-y ] 


[P02 P12 P22 P32] 


[ fo3 ^23 f33 ] 


fP03 Pl3 P23 P33] J 


[ ^04 f)4 ^34 ] 


[P04 Pl4 P24 P34J 


. . . (etc.) 


. . . (etc.) 



Eq.3 



The s„„,lan,y meWcs for each poKntially suspicions lesion in the MLO view of 
cu^n. breas. co„spond .„ fte cos, ftncions E„ i„ E,. 2. „ is ,„ be appreciated ,ha, Ae 
we,gh« c , c. c. and c. are generally diffe^n, ,han ,he we,gh,s a., a,, a,, and a. used K, 
co.pu« suniiari-y „e«cs a, s,ep 70S and U,e weights b. . b„ and b. 'used .0 compute fte 
symme,,y kernes a, step 709. However. *e empirical methods for deriving d,eir values a. 
B«.eral,y s.n.,ar. is expecied ,ha. if .he breas. has no. changed over d,e period of Z 
^"veen n,an»,og™, screenings, *e. will be an ,den.ica, po.en.ially suspicious lesion i 

n " ""^ - for .He cu^n. 

n.amn,og,an,. .. .s expeced .ha. U,ere will be a. leas, one ve.y low similari,y mertc found 

wifl, respect .0 fte prior view of .he same breast. 

.he cla " ^ — " .0 

*e C^stflcahon s.ep 6, Mn HO. 6. However, o.her facors being e,ua,. .he probabi,i.y o, 
25 susp,c.„us..ss ,s incased if for any potentially suspicious lesion in d.e ftrs. view of ^ 
c-™«n^ogram,thereisnota,owsim,,ari,me«cfo.dinr^^^^^^^ 

Ute 0 J' T t T""'" '"'"''■""'^ - """" -1- of 

a CAD system ,n which only step 7,0 (prior view, is carried out bcween s.ep 706 and s^ 
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71 1 in FIG. 7, without the performance of steps 708 (alternate view of same breast) and 709 
(view of opposing breast). Such a CAD system would have the purpose of exclusively 
looking at single view feature vectors, together with similarity metrics with a prior view of 
the same breast, for determining overall suspiciousness. Likewise, in another preferred 
embodiment, only the two steps 710 (prior view) and step 708 (alternate view of same breast) 
5 may be carried out between step 706 and step 7 11 in FIG. 7, while step 709 (opposing breast) 
is not performed. Generally speaking, any single one of the steps 708 (alternate view of same 
breast), 709 (opposing breast), or 71 0 (prior view), or any combination thereof, may be 
performed within the scope of the preferred embodiments. 

FIGS. 8-1 1 are directed to techniques for selecting empirical parameters associated 
10 with the computation of the symmetry and similarity functions described supra. It is to be 
appreciated that one of skill in the art would be able to generate and experimentally determine 
the empirical parameters a,-a„ ho-h,, and C0-C3 and other parameters using methods known in 
the art in conjunction with reviewing the present disclosure. FIGS. 8-1 1 simply display one 
method of determining optimal parameter values that may be modified as needed by the 
IS person skilled in the art as dependent on the goals and specific parameters of a particular 
CAD system. 

FIG. 8 shows an FROC curve 802 corresponding to a computer-aided lesion 
detection device that shows percentage of true positives on the ordinate axis and false 
positives per image on the horizontal or abscissa axis. As known in the art. the FROC curve 
is a quality measure for a given system and/or algorithm used by the system. The FROC 
curve is computed using a large set of digital mammograms, usually more than 100, for which 
the actual number and positions of true lesions are already known and identified. For a first 
level of sensitivity, as determined by setting a sensitivity-affecting variable such as the 
threshold parameter in the linear classifier algorithm at a first level, the lesion detection 
algorithm is run these 100 digital mammograms. The plurality of areas marked as 
"suspicious" by the lesion detection algorithm are then manually examined. The number of 
false positives is recorded, i.e. the number of areas marked "suspicious" which, in reality, are 
not suspicious at all and are not one of the pre-known true lesions. Then, the number of true 
positives are detected, i.e. the number of areas marked "suspicious" which actually are 
suspicious because they are one of the pre-known true lesions. A point is then plotted on 
FIG. 8, the abscissa corresponding to the number of false positives per image, and the 
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ordinate corresponding to the percentage of true positives. The process is then repeated for 
many values of the sensitivity-affecting variable, resuhing in the FROC curve 802 shown in 
FIG. 8. 

Reading the FROC curve of FIG. 8, one can see that, for example, when the 
parameters are adjusted to yield 0.5 of false positives per image, the number of the percentage 
5 of true positives that are recognized, also called sensitivity, is about 81%. If the parameters 
are changed to increase the sensitivity, for example up to 85%, it is found that the number of 
false positives per images becomes 0.8. Generally speaking, it is desirable that the FROC 
curve 802 for a given system be upward and as far to the left as possible in FIG. 8. One 
simple measure of quality based on the FROC curve that could be used for comparison 
10 purposes would simply be the value of TP at a fixed value of FP/Image. The higher this 
value, the better the system. A different measure of quality, more comprehensive than the 
first, could be the integral of the FROC curve from FP/Image = 0 to a predetermined point 
along the abscissa, for example, FP/Image = 0.4. The greater the value of that integral, the 
better the system. 

15 FIG. 9 shows an optimization curve 902 used to generate one empirical 

determination of one of the weights ao, a„ a,, and a. In the example of FIG. 9 the weight a, 
supra, which is associated with region area or region size, is empirically derived, although the 
method disclosed herein may be applied by a person of skill in the art to a variety of different 
parameters in the system. 

"^^ 9 is a plot 902 of system sensitivity at FP/Image = 0.2 (the first quality measure 

disclosed above) against several trial values of the weight a,, with other weights and system 
parameters fixed. To generate the curve of FIG. 9, the parameter a, is set, for example, to 0.5 
with the other parameters being fixed at their pre-assumed values, for example, equal to 
1 .0. The sensitivity at 0.2 FP/Image is then determined as described supra and the value 

25 plotted on the system sensitivity plot 902 of FIG. 9 The weight a, is then changed to 0. 1 and 
the process is repeated. The process is repeated for all values of a, up to a reasonable value 
that shows that an asymptotic or undesired behavior of sensitivity. The peak of the curve of 
plot 902 is then determined as the optimal value for a,. It may be necessary to revisit the 
optimization of a, after optimizing the other weights, which may be done in an iterative 

30 process until convergence as appropriate. As shown in FIG. 9. a value of a, = 0.2 is found to 
be appropriate as it yields the greatest sensitivity of the overall system (at FP/Image = 0.2). 
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FIG. 10 shows clip distance optimization plots 1002 and 1004, each corresponding to 
the area under the FROC curve (the second quality metric described supra) versus certain 
maximum "clipped distances/' In practice, there turns out to be a maximum distance within 
which to consider a "match" between views for potentially suspicious lesions, and between, 
breasts for false regions (due to symmetric structures). These have been given the name 
5 "clip" values for similarity and symmetry. In particular, in a preferred embodiment, it is 
found that at step 608 of FIG. 6, for example, it is not necessary or desirable to compute a 
cost function for every single potentially suspicious lesion in the alternative mammogram 
view. Rather, it is desirable only to compute similarity metrics for potentially suspicious 
lesions that are within a maximum "clip" distance of each other, as determined by the 
10 difference between R^ipple for the respective lesions. These clip distances can be computed 
using the plots shown in FIG. 1 0. 

Plot 1002 of FIG. 10 shows a clip distance optimization plot for the similarity 
metrics. In particular, plot 1002 is derived by first setting a certain maximum clip distance, 
e.g. 100 pixels. Thus, any two potentially suspicious lesions that are greater than 100 pixels 
15 away from each other are not considered in computing their respective similarity metrics. 

Using the technique described supra with respect to FIG. 8, the FROC curve is computed and 
the area thereunder from zero to 0.4 plotted. The maximum distance parameter is then 
increased to 1 50 and the process is repeated. The process is repeated for many values of 
maximum clip distance and the optimal value identified at the peak of plot 1002. 
20 In the example of FIG. 1 0, it is found for example that the best maximum clip 

distance is 150 when considering similarity metrics. As shown in FIG. 10 at element 1004 
similar techniques can be used to find maximum clip distance for symmetry comparisons as 
well. The plots of FIG. 10 are intuitively correct - if the maximum clip distance is extremely 
small, then similar features in alternate views will not be considered and will not be captured 
25 in the similarity metric and so the measure of quality is low. However if the maximum clip 
distance is very, very large, then there is no limitation at all on which potentially suspicious 
lesions are computed into the similarity metric and no value is added at all by using a 
maximum clip distance, as reflected by the asymptotic behavior of the curves. Finally, 
however, at an intermediate maximum distance, it is found that the qualit\' measure increases 
30 because a proper radius of potentially suspicious lesions is considered. 

FIG. 1 1 shows optimization plots 1 1 02 and 1 1 04 corresponding to a technique for 
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determining a maximum improbability associated with suspicious lesions in alternate views 
that may be used in a manner similar to the maximum clip distance in FIG. 10. In a preferred 
embodiment, a potentially suspicious lesion in an alternate view will not be considered in the 
computation of symmetry or similarity metrics unless it in itself has some certain minimum 
probability of being a potentially suspicious lesion. This step is taken in a preferred 
5 embodiment because inordinate weight might otherwise be given to very insignificant 

features that are nevertheless very close in feature-space distance to each other in the multiple 
views. Accordingly, a threshold probability of suspiciousness (as calculated from the single 
view lesion detection algorithm of steps 304-306, for example) should be set before all 
potentially suspicious lesions are identified and used in the computation of the similarity or 
10 symmetry metrics. Accordingly, FIG. 1 1 plots shows a change in threshold for probability 
versus the quality curve of the system on the vertical axis. The optimal value for maximum 
improbability is identified at the peaks of the respective curves. 

While preferred embodiments of the invention have been described, these 
descriptions are merely illustrative and are not intended to limit the present invention. For 
15 example, although the embodiments of the invention described above were in the context of a 
system for computer aided diagnosis and detection of breast carcinoma in x-ray films, those 
skilled in the art will recognize that the disclosed methods and structures are readily adaptable 
for broader applications. For example, the invention is applicable to many other types of 
CAD systems for detection of other types of medical abnormalities. 

20 
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1 . A method for detecting suspicious lesions in a breast using information from a first 
digital mammogram view of the breast and a second digital mammogram view of the breast. 
5 comprising the steps of: 

locatmg a first set of potentially suspicious lesions in said first digital 
mammogram view, each of said first set of potentially suspicious lesions having a 
single-view feature vector corresponding thereto; 

locating a second set of potentially suspicious lesions in said second digital 
10 mammogram view; 

computing a similarity metric between each of said first set of potentially 
suspicious lesions and each of said second set of potentially suspicious lesions; 
and 

classifying each of said first set of potentially suspicious lesions using 
15 information from the corresponding single-view feature vector and from the 

corresponding similarity metrics. 

2. The method of claim 1, wherein said step of classifying each of said first set of 
potentially suspicious lesions is performed using a classification algorithm in which the 



20 
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single-view feature vector associated with that potemially suspicious lesion is processed 
along with the corresponding similarity metrics, and wherein a greater probability of 
suspiciousness is determined if that potemially suspicious lesion is highly similar to a 
potentially suspicious lesion in the second digital mammogram view. 



3 The method of claim 2, each of said second set of potemially suspicious lesions also 

having a single-view feature vector, said single-view feature vectors associated with said first 
and second sets of potentially suspicious lesions comprising location information, wherein 
said step of computing a similarity metric comprises die step of comparing location 
information between each of said first set of potentially suspicious lesions and each of said 
30 second set of potentially suspicious lesions. 
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4. The method of claim 3. wherein said location information includes a nipple distance 
corresponding to a distance of the potentially suspicious lesion from the nipple of the breast 
in its respective digital mammogram view. 

5, The method of claim 4, further comprising the step of locating the nipple of the 

5 breast in each digital mammogram view, said step of locating the nipple comprising the steps 
of: 

segmenting that digital mammogram view for determining the position of the 
chest wall of the breast; 

determining a most prominent direction of lines in the breast tissue relative to 
B the chest wall for that digital mammogram view; 

segmenting that digital mammogram view for determining the location of the 
skin line of the breast; and 

selecting the location of the nipple on that digital mammogram view as the 
furthest point along said skin line from said chest wall as measured along said most 
^ prominent direction of lines. 

6. The method of claim 5, wherein said nipple distance is equal to the radial distance of 
the potentially suspicious lesion from the nipple in that digital mammogram view. 

7. The method of claim 5. wherein said nipple distance is equal to the difference 
between (a) the distance of the nipple from the chest wall and (b) the distance of the 
potentially suspicious lesion from the chest wall. 

8. The method of claim 5, wherein said single-view feature vector for each potentially 
suspicious lesion further comprises (1) an area metric related to the area of the potentially 
suspicious lesion, and (2) a contrast metric related to the contrast of the potentially suspicious 
lesion relative to the surrounding tissue area, and wherein said similarity metric is computed 
by computing a weighted distance in feature vector space betxveen the potentially suspicious 
lesion in the first digital mammogram view and the potentially suspicious lesion in the second 
digital mammogram view. 
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9. The method of claim 8. wherein that potentially suspicious lesion is highly similar to 
the potentially suspicious lesion in the second digital mammogram view if said weighted 
distance in feature vector space has a low numerical value, wherein said weighted distance in 
feature vector space is a weighted Euclidean distance computed using the steps of: 

determining a difference in nipple distance between the potentially suspicious lesion 
5 in the first digital mammogram view and the potentially suspicious lesion in the second 
digital mammogram view; 

squaring said difference in nipple distance and weighting the result by a nipple 
distance weighting factor; 

determining a difference in area metric between the potentially suspicious lesion in 
10 the first digital manmiogram view and the potentially suspicious lesion in the second digital 
mammogram view; 

squaring said difference in area metric and weighting the result by an area metric 
weighting factor; 
and 

15 computing said weighted Euclidean distance by computing the square root of the sum 

of said weighted squared differences. 



20 

11. 



10. The method of claim 9, wherein said nipple distance weighting factor is selected to 
be at least approximately five times greater than said area metric weighting factor. 



The method of claim 1 0, said single^view feature vectors each further comprising a 
spiculation metric corresponding to the spiculatedness of the potentially suspicious lesion, 
wherein said weighted distance in feature vector space is ftirther computed using the steps of: 
determining a difference in spiculation metric between the potentially suspicious 
25 lesion in the first digital mammogram view and the potentially suspicious lesion in the second 
digital mammogram view; 

squaring said difference in spiculation metric and weighting the result by a 
spiculation metric weighting factor; 

determining a difference in contrast metric between the potentially suspicious lesion 
30 in the first digital mammogram view and the potentially suspicious lesion in the second 
digital mammogram view; 
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squaring said difference in contrast metric and weighting the result by a contrast 
metric weighting factor; 
and 

including said weighted squared spiculation and contrast metrics in said sum of said 
weighted squared differences. 

12. A method for detecting suspicious lesions in a first breast using information from a 
first digital mammogram thereof and a second digital mammogram of an opposite breast, 
comprising the steps of: 

locating a first set of potentially suspicious lesions in said first digital 
mammogram, each of said first set of potentially suspicious lesions having a single- 
view feature vector corresponding thereto; 

locating a second set of potentially suspicious lesions in said second digital 
mammogram; 

computing a symmetry metric between each of said first set of potentially 
suspicious lesions and each of said second set of potentially suspicious lesions; 
and 

classifying each of said first set of potentially suspicious lesions using 
information from the corresponding single-view feature vector and from the 
corresponding symmetry metrics relating that potentially suspicious lesion to 
potentially suspicious lesions in the opposite breast. 

13. The method of claim 12, wherein said step of classifying each of said first set of 
potentially suspicious lesions is performed using a classification algorithm in which the 
single-view feature vector associated with that potentially suspicious lesion is processed 
along with the corresponding symmetry metrics relating that potentially suspicious lesion to 
potentially suspicious lesions in the opposite breast and wherein a lesser probability of 
suspiciousness is determined if that potentially suspicious lesion is highly symmetric with a 
potentially suspicious lesion in the opposite breast. 

14. The method of claim 13, each of said second set of potentially suspicious lesions also 
having a single-view feature vector, said single-view feature vectors associated with said first 
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and second sets of potentially suspicious lesions comprising location information, wherein 
said step of computing a similarity metric comprises the step of comparing location 
information between each of said first set of potentially suspicious lesions and each of said 
second set of potentially suspicious lesions. 

15. The method of claim 14, wherein said location information includes a nipple distance 
corresponding to a distance of the potentially suspicious lesion from the nipple of the breast 
in its respective digital mammogram. 

16. The method of claim 15, further comprising the step of locating the nipple of the 
breast in each of said first and second digital mammograms, said step of locating the nipple in 
a respective digital mammogram comprising the steps of: 

segmenting the digital mammogram for determining the position of the chest 
wall of the breast; 

determining a most prominent direction of lines in the breast dssue relative to 
the chest wall for the digital mammogram; 

segmenting the digital mammogram for determining the location of the skin 
line of the breast; and 

selecting the location of the nipple on the digital mammogram as the furthest 
point along said skin line from said chest wall as measured along said most 
prominent direction of lines. 

1 7. The method of claim 1 6, wherein said nipple distance is equal to the radial distance 
of the potentially suspicious lesion from the nipple in the digital mammogram. 

1 8. The metiiod of claim 1 6, wherein said nipple distance is equal to the difference 
between (a) the distance of the nipple from the chest wall and (b) the distance of the 
potentially suspicious lesion from the chest wall. 

1 9. The method of claim 1 5, wherein said single-view feature vector for each potentially 
suspicious lesion further comprises an area metric related to the area of tiie potentially 
suspicious lesion, and a contrast metric related to the contrast of the potentially suspicious 
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lesion relative to the surrounding tissue area, and wherein said symmetr>' metric is computed 
by computing a weighted distance in feature vector space between the potentially suspicious 
lesion in the first digital mammogram and the potentially suspicious lesion in the second 
digital mammogram. 

5 20. The method of claim 1 9, wherein that potentially suspicious lesion is highly 

symmetric with the potentially suspicious lesion in the second digital mammogram if said 
weighted distance in feature vector space has a low numerical value, wherein said weighted 
distance in feature vector space is a weighted Euclidean distance computed using the steps of: 
determining a difference in nipple distance between the potentially suspicious lesion 
10 in the first digital mammogram and the potentially suspicious lesion in the second digital 
mammogram; 

squaring said difference in nipple distance and weighting the result by a nipple 
distance weighting factor; 

determining a difference in area metric between the potentially suspicious lesion in 
15 the first digital mammogram and the potentially suspicious lesion in the second digital 
meunmogram; 

squaring said difference in area metric and weighting the result by an ai«a metric 
weighting factor; 
and 

20 computing said weighted Euclidean distance by computing the square root of the sum 

of said weighted squared differences. 
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21. The method of claim 20, wherein said nipple distance weighting factor is selected to 
be at least approximately five times greater than said area metric weighting factor. 

22. The method of claim 2 1 , said single-view feature vectors each fiarther comprising a 
spiculation metric corresponding to the spiculatedness of the potentially suspicious lesion, 
wherein said weighted distance in feature vector space is further computed using the steps of: 

determining a difference in spiculation metric between the potentially suspicious 
lesion in the first digital mammogram and the potentially suspicious lesion in the second 
digital mammogram; 
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squaring said difference in spiculation metric and weighting the result by a 
spiculation metric weighting factor; 

determining a difference in contrast metric between the potentially suspicious lesion 
in the first digital mammogram and the potentially suspicious lesion in the second digital 
mammogram; 

5 squaring said difference in contrast metric and weighting the result by a contrast 

metric weighting factor; 
and 

including said weighted squared spiculation and contrast metrics in said sum of said 
weighted squared differences. 

10 

23. A method for locating a nipple in a digital manmiogram of a breast, comprising the 
steps of: 

segmenting the digital mammogram for determining the position of the chest 
wall of the breast in the digital mammogram; 

determining a most prominent direction of lines in the breast tissue relative to 
the chest wall; 

segmenting the digital mammogram for determining the location of the skin 
line of the breast in the digital mammogram; 
and 

selecting the location of the nipple as the furthest point along said skin line 
from said chest wall as measured along said most prominent direction of lines. 

24. The method of claim 23, said step of determining a most prominent direction of lines 
comprising the step of: 

locating prominent lines in the digital mammogram; 

determining the directions of said prominent lines as measured with respect to 
said chest wall; 

computing a histogram of said directions of said prominent lines; 
and 

selecting the most prominent direction of lines as the direction corresponding 
to a maximum value of said histogram. 
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25. A method for detecting suspicious lesions in a first breast using information from a 
first digital mammogram thereof taken from a first view, a second digital mammogram 
thereof taken from a second view different than the first view, and a third digital mammogram 
taken of an opfX)site breast, comprising the steps of: 

locating a first set of potentially suspicious lesions in said first digital 
5 mammogram, each of said first set of potentially suspicious lesions having a single- 

view feature vector corresponding thereto; 

locating a second set of potentially suspicious lesions in said second digital 
mammogram of the breast, each of said second set of potentially suspicious lesions 
having a single-view feature vector corresponding thereto; 

locating a third set of potentially suspicious lesions in said third digital 
mammogram, each of said third set of potentially suspicious lesions having a single- 
view feature vector corresponding thereto; 

computing a similarity metric between each of said first set of potentially 
suspicious lesions and each of said second set of potentially suspicious lesions; 

computing a symmetry metric between each of said first set of potentially 
suspicious lesions and each of said third set of potentially suspicious lesions; 
and 

classifying each of said first set of potentially suspicious lesions using 
mformation from the (a) the corresponding single-view feature vector, (b) the 
corresponding similarity mettics relating that potentially suspicious lesion to 
potentially suspicious lesions in the different view of the same breast, and (c) the 
corresponding symmetry metrics relating that potentially suspicious lesion to 
potentially suspicious lesions in the opposite breast. 

25 26. The method of claim 25, wherein said step of classifying each of said first set of 
potentially suspicious lesions is performed using a classification algorithm in which the 
single-view feature vector associated with that potentially suspicious lesion is processed 
along with the corresponding similarity and symmetry metrics, wherein a greater probability 
of suspiciousness is determined if that potentially suspicious lesion is highly similar to a 

30 potentially suspicious lesion in the second digital mammogram, and wherein a lesser 
probability of suspiciousness is determined if that potentially suspicious lesion is highly 
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symmetric with a potentially suspicious lesion in the third digital mammogram. 



27. The method of claim 26, said single-view feature vectors comprising location 
information, wherein said step of computing a similarity metric comprises the step of 
comparing location information between each of said first set of potentially suspicious lesions 
5 and each of said second set of potentially suspicious lesions, and wherein said step of 

computing a symmetry metric comprises the step of comparing location information between 
each of said first set of potentially suspicious lesions and each of said third set of potentially 
suspicious lesions. 



10 28. The method of claim 27, wherein said location information includes a nipple distance 
corresponding to a distance of the potentially suspicious lesion from the nipple of the breast 
in its respective digital mammogram. 

29. The method of claim 28, wherein said single-view feature vector for each potentially 
15 suspicious lesion further comprises an area metric related to the area of the potentially 

suspicious lesion, and a contrast metric related to the contrast of the potentially suspicious 
lesion relative to the surrounding tissue area, wherein said similarit>' metric is computed by 
computing a weighted distance in feature vector space between the potentially suspicious 
lesion in the first digital mammogram and the potentially suspicious lesion in the second 
20 digital mammogram, and wherein symmetry metric is computed by computing a weighted 
distance in feature vector space between the potentially suspicious lesion in the first digital 
mammogram and the potentially suspicious lesion in the third digital mammogram. 

30. The method of claim 29, wherein that potentially suspicious lesion is highly similar 
25 to the potentially suspicious lesion in the second digital mammogram if said weighted 

distance in feature vector space has a low numerical value, wherein said weighted distance in 
feature vector space is a weighted Euclidean distance computed using the steps of: 

determining a difference in nipple distance between the potentially suspicious lesion 
in the first digital mammogram and the potentially suspicious lesion in the second digital 
30 mammogram; 

squaring said difference in nipple distance and weighting the result by a similarity 
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nipple distance weighting factor: 

determining a difference in area metric between the potentially suspicious lesion in 
the first digital mammogram and the potentially suspicious lesion in the second digital 
manrmiogram; 

squaring said difference in area metric and weighting the result by an similarity area 
5 metric weighting factor; 
and 

computing said weighted Euclidean distance by computing the square root of the sum 
of said weighted squared differences. 



10 



3 1 . The method of claim 30, wherein that potentially suspicious lesion is highly 
symmetric with the potentially suspicious lesion in the third digital mammogram if said 
weighted distance in feature ^•ector space has a low numerical value, wherein said weighted 
distance in feature vector space is a weighted Euclidean distance computed using the steps of: 
determining a difference in nipple distance between the potentially suspicious lesion 
15 in the first digital mammogram and the potentially suspicious lesion in the third digital 
mammogram; 

squaring said difference in nipple distance and weighting the result by a symmetiy 
nipple distance weighting factor; 

determining a difference in area metric between the potentially suspicious lesion in 
20 the first digital mammogram and the potemially suspicious lesion in the third digital 
mammogram; 

squaring said difference in.area metric and weighting the result by an symmetry area 
metric weighting factor; 
and 

25 computing said weighted Euclidean distance by computing the square root of the sum 

of said weighted squared differences. 

32. The method of claim 3 1 , wherein said similaritj' nipple distance weighting factor is 
approximately equal to said symmetr>' nipple distance weighting factor, and wherein said 
30 similarity area metric weighting factor is approximately equal to aid symmetry area metric 
weighting factor. 
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33. The method of claim 32, wherein said similariu' nipple distance weighting factor is at 
least approximately five times greater than said similarit>' area metric weighting factor. 

34. A computer program product for directing a computer-aided lesion detection 
apparatus to detect suspicious lesions in a breast using information from a first digital 

5 mammogram view of the breast and a second digital mammogram view of the breast, 
comprising: 

computer code for locating a first set of potentially suspicious lesions in said 
first digital mammogram view, each of said first set of potentially suspicious lesions 
having a single-view feature vector corresponding thereto; 

computer code for locating a second set of potentially suspicious lesions in 
said second digital mammogram view; 

computer code for computing a similarit>' metric between each of said first set 
of potentially suspicious lesions and each of said second set of potentially suspicious 
lesions; 
15 and 

computer code for classifying each of said first set of potentially suspicious 
lesions using information from the corresponding single-view feature vector and 
from the corresponding similarity metrics. 

20 35. The computer program product of claim 34, wherein said computer code for 

classifying each of said first set of potentially suspicious lesions comprises computer code for 
performing a classification algorithm in which the single-view feature vector associated with 
that potentially suspicious lesion is processed along with the corresponding similarity metrics, 
and wherein a greater probability of suspiciousness is detemined if that potentially suspicious 
lesion is highly similar to a potentially suspicious lesion in the second digital mammogram 



25 

view 



36. A computer program product for directing a computer-aided lesion detection 
apparatus to detect suspicious lesions in a first breast using information fi-om a first digital 
mammogram thereof and a second digital mammogram of an opposite breast, comprising: 
computer code for locating a first set of potentially suspicious lesions in said 
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first digital mammogram, each of said first set of potentially suspicious lesions 
having a single-view feature vector corresponding thereto; 

computer code for locating a second set of potentially suspicious lesions in 
said second digital mammogram; 

computer code for computing a symmetry metric between each of said first set 
5 of potentially suspicious lesions and each of said second set of potentially suspicious 

lesions; 

and 

computer code for classifying each of said first set of potentially suspicious 
lesions using information from the corresponding single-view feature vector and 
10 from the corresponding symmetry metrics relating that potentially suspicious lesion 

to potentially suspicious lesions in the opposite breast. 

37. The computer program product claim 36, wherein said computer code for classifying 
each of said first set of potentially suspicious lesions comprises computer code for performing 

15 a classification algorithm in which the single-view feature vector is processed along with the 
corresponding symmetry metrics relating that potentially suspicious lesion to potentially 
suspicious lesions in the opposite breast, and wherein a lesser probability of suspiciousness is 
determined if that potentially suspicious lesion is highly symmetric with a potentially 
suspicious lesion in the opposite breast. 

20 

38. A computer program product for directing a computer-aided lesion detection 
apparatus to locate a nipple in a digital mammogram of a breast, comprising: 

computer code for segmenting the digital mammogram to determine the 
position of the chest wall of the breast in the digital mammogram; 

computer code for determining a most prominent direction of lines in the 
breast tissue relative to the chest wall; 

computer code for segmenting the digital mammogram to determine the 
location of the skin line of the breast in the digital mammogram; 

and 

computer code for selecting the location of the nipple as the furthest point 
along said skin line from said chest wall as measured along said most prominem 
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direction of lines. 



39. A computer program product directing a computer-aided lesion detection apparatus 
to detect suspicious lesions in a first breast using information from a first digital mammogram 
thereof taken from a first view, a second digital mammogram thereof taken from a second 
5 view different than the first view, and a third digital mammogram taken of an opposite breast, 
comprising: 

computer code for locating a first set of potentially suspicious lesions in said 
first digital mammogram, each of said first set of potentially suspicious lesions 
having a single-view feature vector corresponding thereto; 

computer code for locating a second set of potentially suspicious lesions in 
said second digital mammogram of the breast, each of said second set of potentially 
suspicious lesions having a single-view feature vector corresponding thereto; 

computer code for locating a third set of potentially suspicious lesions in said 
third digital mammogram, each of said third set of potentially suspicious lesions 
having a single-view feature vector corresponding thereto; 

computer code for computing a similarity metric between each of said first set 
of potentially suspicious lesions and each of said second set of potentially suspicious 
lesions; 

computer code for computing a symmetry metric between each of said first set 
of potentially suspicious lesions and each of said third set of potentially suspicious 
lesions; 
and 

computer code for classifying each of said first set of potentially suspicious 
lesions using information from the (a) the corresponding single-view feature vector, 
(b) the corresponding similarity metrics relating that potentially suspicious lesion to 
potentially suspicious lesions in the different view of the same breast, and (c) the 
corresponding symmetry metrics relating that potentially suspicious lesion to 
potentially suspicious lesions in the opposite breast. 



4U. The computer program product of claim 39, wherein said computer code for 
classifying each of said first set of potentially suspicious lesions comprises computer code for 
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performing a classification algorithm in which the single-view feature vector associated with 
that potentially suspicious lesion is processed along with the corresponding similarity and 
symmetry metrics, wherein a greater probability of suspiciousness is determined if that 
potentially suspicious lesion is highly similar to a potentially suspicious lesion in the second 
digital mammogram, and wherein a lesser probability of suspiciousness is determined if that 
potentially suspicious lesion is highly symmetric with a potentially suspicious lesion in the 
third digital mammogram. 



41. A method for detecting suspicious lesions in a breast using information from a first 
digital mammogram thereof and a second digital mammogram thereof, comprising the steps 
of: 

locating a first set of potentially suspicious lesions in said first digital 
mammogram, each of said first set of potentially suspicious lesions having a single- 
view feature vector corresponding thereto; 

locating a second set of potentially suspicious lesions in said second digital 
mammogram; 

computing a similarity metric between each of said first set of potentially 
suspicious lesions and each of said second set of potentially suspicious lesions; 
and 

classifying each of said first set of potentially suspicious lesions using 
information from the corresponding single-view feature vector and fi-om the 
corresponding similarit>' metrics; 

wherein said first digital mammogram and said second digital mammogram 
correspond to mammograms of the breast taken at substantially different times, 
whereby change in the breast over time that may indicate one or more cancerous 
conditions may be detected. 

42. The method of claim 41, wherein said step of classifying each of said first set of 
potentially suspicious lesions is performed using a classification algorithm in which the 
single-view feature vector associated with that potentially suspicious lesion is processed 
along with the corresponding similarity metrics, and wherein a lesser probability of 
suspiciousness is determined if that potentially suspicious lesion is highly similar to one of 
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said second set of potentially suspicious lesions in said second digital mammogram. 



43. The method of claim 42. wherein said first digital mammogram and said second 
digital mammogram are least 6 months apart in time. 

44. The method of claim 43, wherein said first digital mammogram is taken prior to said 
second digital mammogram. 

45. A computer program product for directing a computer-aided lesion detection 
apparatus to detect suspicious lesions in a breast using information from a first digital 
mammogram thereof and a second digital mammogram thereof, comprising: 

computer code for locating a first set of potentially suspicious lesions in said 
first digital mammogram, each of said first set of potentially suspicious lesions 
having a single-view feature vector corresponding thereto; 

computer code for locating a second set of potentially suspicious lesions in 
said second digital mammogram; 

computer code for computing a similarity metric between each of said first set 
of potentially suspicious lesions and each of said second set of potentially suspicious 
lesions; 

and 

computer code for classifying each of said first set of potentially suspicious 
lesions using information from the corresponding single-view feature vector and 
from the corresponding similarity metrics; 

wherein said first digital mammogram and said second digital mammogram 
correspond to mammograms of the breast taken at substantially different times, 
whereby change in the breast over time that may indicate one or more cancerous 
conditions may be detected. 

46. The computer program product of claim 45, wherein said computer code for 
classifying each of said first set of potentially suspicious lesions comprises computer code for 
performing a classification algorithm in which the single-view feature vector associated with 
that potentially suspicious lesion is processed along with the corresponding similarity metrics, 
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and wherein a lesser probability of suspiciousness is determined if that potentially suspicious 
lesion is highly similar to one of said second set of potentially suspicious lesions in said 
second digital mammogram. 

47. The computer program product of claim 45, wherein said first digital mammogram 
and said second digital mammogram are least 6 months apart in time. 

48. The computer program product of claim 47, wherein said first digital mammogram is 
taken prior to said second digital mammogram. 

49. A method for detecting suspicious lesions in a breast using information from a first 
digital mammogram thereof taken from a first view, a second digital mammogram thereof 
taken from a second view different than the first view, and a third digital mammogram thereof 
taken at a time prior to the time at which the first digital mammogram was taken, comprising 
the steps of: 

locating potentially suspicious lesions in each of said first, second, and third 
digital mammograms to produce a first, second, and third set of potentially 
suspicious lesions, respectively, each of said potentially suspicious lesions having a 
single-view feature vector corresponding thereto; 

computing a similarity metric between each of said first set of potentially 
suspicious lesions and each of said second set of potentially suspicious lesions; 

computing a similarity metric between each of said first set of potentially 
suspicious lesions and each of said third set of potentially suspicious lesions; 

and 

classifying each of said first set of potentially suspicious lesions using 
information from the (a) the corresponding single-view feature vector, (b) the 
corresponding similarity metrics relating that potentially suspicious lesion to 
potentially suspicious lesions in the second digital mammogram, and (c) the 
corresponding similarity metrics relating that potentially suspicious lesion to 
potentially suspicious lesions in the third digital mammogram; 

wherein said step of classifying each of said first set of potentially suspicious 
lesions is performed using a classification algorithm in which the single-view feature 
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vector associated with that potentially suspicious lesion is processed along with the 
corresponding similarity metrics, wherein a greater probability of suspiciousness is 
determined if that potentially suspicious lesion is highly similar to a potentially 
suspicious lesion in the second digital mammogram view, and wherein a lesser 
probability of suspiciousness is determined if that potentially suspicious lesion is 
highly similar to a potentially suspicious lesion in the third digital mammogram 
view. 



50. A method for detecting suspicious lesions in a breast using information from a first 
digital mammogram thereof taken from a first view, a second digital mammogram thereof 
taken at a time prior to the time at which the first digital mammogram was taken, and a third 
digital mammogram of the opposing breast, comprising the steps of: 

locating potentially suspicious lesions in each of said first, second, and third 
digital mammograms to produce a first, second, and third set of potentially 
suspicious lesions, respectively, each of said potentially suspicious lesions having a 
single -view feature vector corresponding thereto; 

computing a similarity metric between each of said first set of potentially 
suspicious lesions and each of said second set of potentially suspicious lesions; 

computing a symmetry metric between each of said first set of potentially 
suspicious lesions and each of said third set of potentially suspicious lesions; 
and 

classifying each of said first set of potentially suspicious lesions using 
information from the (a) the corresponding single-view feature vector, (b) the 
corresponding similarity metrics relating that potentially suspicious lesion to 
potentially suspicious lesions in the second digital mammogram, and (c) the 
corresponding symmetry metrics relating that potentially suspicious lesion to 
potentially suspicious lesions in the third digital mammogram; 

wherein said step of classifying each of said first set of potentially suspicious 
lesions is performed using a classification algorithm in which the single-view feature 
vector associated with that potentially suspicious lesion is processed along with the 
corresponding symmetry and similarity metrics, wherein a lesser probability of 
suspiciousness is determined if that potentially suspicious lesion is highly similar to a 

-41- 



wo 00/25255 



PCTAJS99/25137 



potentially suspicious lesion in the second digital mammogram view, and wherein a 
lesser probability of suspiciousness is determined if that potentially suspicious lesion 
is highly symmetric with a potentially suspicious lesion in the third digital 
mammogram view. 
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